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FIELD OF THE DISCLOSURE 

[1001] The present disclosure relates to digital imaging technology, and more 
particularly to a digital image capturing system and method. 



BACKGROUND OF THE DISCLOSURE 

[1002] Digital image capturing devices, like digital still cameras and digital video 
cameras, store image information digitally rather than or in addition to recording the 
information on film. Digital image capture typically involves the conversion of incident 
light or photons into electronic charge with a photoconversion process. Whether 
marketed to a consumer or a professional user, digital cameras have traditionally relied 
on Charge-Coupled Device (CCD) sensors to "see" the subject image or scene. 

[1003] In recent years, Complimentary Metal Oxide Silicon (CMOS) integrated circuits 
(ICs) sensors have replaced CCD-sensors in entry-level devices. CMOS image sensors 
usually cost less than CCD image sensors and have facilitated the manufacturing of lower 
cost and lower power digital cameras. This advancement, along with the increased 
availability of broadband access to communication networks like the Internet, has helped 
to create a large market for new multimedia applications and services. 

[1004] As mentioned above, the migration from analog to digital camera technologies 
was accelerated by the development of CMOS-based image sensors. A typical CCD 
image sensor requires specialized processing that is largely incompatible with other logic 
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circuits and the semiconductor manufacturing processes. Additionally, CCD devices tend 
to have higher voltage and power requirements than CMOS image sensors. This 
combination of characteristics drives up the manufacturing cost of high resolution CCD 
sensor as compared with CMOS sensors of similar quality. 



BRIEF DESCRIPTION OF THE DRAWINGS 

[1005] The present invention is pointed out with particularity in the appended claims. 
However, features are described in the following detailed description in conjunction with 
the accompanying drawings in which: 

[1006] FIG. 1 shows a block diagram of a digital image sensing system incorporating 
teachings of the present disclosure; 

[1007] FIG. 2 depicts a communication system with an imaging device that incorporates 
teachings of the present disclosure. The imaging device of FIG. 2 has a single instance of 
image processing capability supporting several image sensor lens modules; and 

[1008] FIG. 3 depicts a top view of an imaging appliance that incorporates teachings of 
the present disclosure. 



DETAILED DESCRIPTION OF THE DRAWINGS 

[1009] With the rapid evolution of digital imaging technology and data communication, 
the need or at least the desire to capture images and to electronically send and receive 
those images is increasing. To satisfy this need, image pickup devices, such as CCD and 
CMOS image sensors, have been utilized to help create the digital photography industry. 

[1010] As mentioned above, FIG. 1 shows a block diagram of a digital image sensing 
system 10, which incorporates teachings of the present disclosure. In the embodiment of 
FIG. 1, system 10 includes two image sensor lens (ISL) modules 12 and 14. An ISL may 
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be formed from the integration of a lens and a sensor. When a sensor, be it CMOS or 
CCD, is packaged with a lens, the resulting module may form an image sensor lens (ISL) 
module. Such an ISL may facilitate lower cost manufacturing of cameras for 
videoconferencing equipment, traffic monitoring solutions, space and security 
surveillance devices, personal computers, or PDAs. An example ISL may be Sharp 
Corporations LZOP3800. 

[1011] Modules 12 and 14 may include CCD, CMOS, or other appropriate sensors. In 
lower cost embodiments, modules 12 and 14 maybe CMOS devices, as CMOS sensors 
are often easier to build. Manufacturing a CCD sensor typically involves the VLSI 
process, or very large-scale integration process - a technique used to place hundreds of 
thousands of electronic components on a single chip. In the CCD manufacturing process, 
a closely packed mesh of polysilicon electrodes is formed on the surface of a chip. 
During the operation of a CCD sensor, individual packets of electrons may be kept intact 
while they are physically moved from the position where light was detected, across the 
surface of the chip, to an output amplifier. 

[1012] CCD sensors often capture a high quality image, but translating the captured 
image into the "picture" taken by a CCD-based device often requires several additional 
chips. A chip or integrated circuit typically refers to a unit of packaged electronic 
circuitry manufactured from a material like silicon at a small scale or very small scale. 

[1013] A typical chip may contain, among other things, program logic and memory. 
Chips may be made to include combinations of logic and memory and used for special 
purposes such as analog-to-digital (A/D) conversion, bit slicing, etc. In some 
embodiments of a CCD-device, camera functions, like clock drivers, timing logic, as well 
as signal processing may be implemented in secondary chips. As a result, most CCD 
cameras tend to have several chips or integrated circuits. 

[1014] CMOS imagers sense light in the same way as CCD imagers, but once the light 
has been detected, CMOS devices operate differently. The charge packets are not usually 
transferred across the device. They are instead detected at an early stage by charge 
sensing amplifiers, which may be made from CMOS transistors. 
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[1015] In some CMOS sensors, amplifiers are implemented at the top of each column of 
pixels - the pixels themselves contain just one transistor, which may also be used as a 
charge gate, switching the contents of the pixel to the charge amplifiers. This type of 
sensor may be referred to as a passive pixel CMOS sensor. In active pixel CMOS 
sensors, amplifiers are implemented in each pixel. Active pixel CMOS sensors often 
contain at least 3 transistors per pixel. Generally, the active pixel form of CMOS sensor 
has lower noise but poorer packing density than passive pixel CMOS sensors. 

[1016] CMOS cameras may also enjoy a relatively high level of integration - in that 
much of the camera functions may be included on the same chip as the CMOS sensor. In 
the embodiment depicted in FIG. 1, modules 12 and 14 share a chip, chip 16, with several 
other pieces of logic and memory. For example, processing engine 1 8, which may 
perform various image processing functions like artifact removal or correction, exposure 
control, white balance, zoom, etc., is located on chip 16. Processing engine 18 may be 
communicatively coupled via link 20 with memory 22. 

[1017] The combination of process engine 18 and memory 22 may form a processing 
electronics module 24, which supports both module 12 and module 14. Processing 
electronics module 24 may also perform other camera related functions like bus 
management, analog to digital conversion (A/D conversion) or timing and clocking 
functions. As shown in FIG. 1, various image processing and camera management 
functions may be implemented on-chip with multiple modules to effectively make a 
complete one-chip camera. 

[1018] If the sensors 26 and 28, which help to make up modules 12 and 14, respectively, 
are CMOS image sensors, a camera incorporating chip 16 may be manufactured at a 
relatively low cost and may consume about l/3 rd to l/5 th as much power as an equivalent 
CCD-based camera. As depicted, sensors 26 and 28 include several pixels and help to 
form modules 12 and 14. Other components of modules 12 and 14 include lens 30 and 
32, which may be the same or different. 

[1019] As mentioned above, key peripheral circuitry, which may include logic, memory, 
or both, may be integrated onto chip 16 within processing electronics module 24 or 
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elsewhere or as part of a related chipset. The peripheral circuitry may include a digital 
signal processing (DSP) core, a timing IC (which may generate timing pulses to drive a 
sensor), CDS (Correlated Double Sampling noise reduction), AGC (Automatic Gain 
Control to stabilize output levels), 8-bit A/D converter, etc. Though potentially easier 
with CMOS-based sensors, the peripheral circuitry may be integrated with either CCD or 
CMOS sensors. It may be more cost effective when integrating with a CMOS sensor, 
because the peripheral circuitry may be more easily included on the same chip as the 
sensor. 

[1020] hi addition to simpler peripheral component integration, CMOS sensor 
technology may also allow individual pixels to be randomly accessed at high speed. As a 
result, applications like electronic zooming and panning may be performed at relatively 
high speeds with an embodiment like system 10. As shown, system 10 has a single 
instance of image and camera control circuitry, embodied in processing electronics 
module 24, supporting both ISL modules 12 and 14. 

[1021] In operation of system 10, a selection mechanism, like selector 34, may act as a 
gatekeeper or router. Selector 34 may be responsive to processing electronics module 24 
and may selectively route raw or minimally processed image information captured by 
modules 12 and 14 to processing engine 18. In some embodiments, processing engine 18 
maybe capable of simultaneously processing image information from both module 12 
and module 14. In other embodiments, processing engine 18 may be designed to process 
image data from one module at a time. 

[1022] Selector 34 may be defined for a given application to offer seamless or near- 
seamless views of different scenes and objects. Selector 34 may include a triggering 
engine as well as a switching engine. In an embodiment where module 12 and module 14 
are capturing different views of a common scene, a triggering engine may be capable of 
determining which module is capturing the desired view. With multi-view capabilities, 
system 10 may be incorporated into several different camera designs and/or applications. 
For example, still cameras, videoconferencing cameras, traffic monitoring cameras, or 
space and security cameras, could all make use of the teachings of this disclosure. 
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[1023] As mentioned above, FIG. 2 depicts a communication system 36 with an imaging 
device 38 that incorporates teachings of the present disclosure. Imaging device 38 may 
have a single instance of processing electronics 40 supporting several image sensor lens 
modules 42, 44, 46, 48, and 50. In a device 38 embodiment in which processing 
electronics 40 processes image information from one module at a time, a selection 
mechanism 52 or other selector may be used to choose which image information is 
forwarded along or routed to processing electronics 40. 

[1024] In one embodiment of device 38, modules 42, 44, 46, 48, and 50 may be CMOS- 
based ISL modules and processing electronics 40 may include advanced image and video 
processing technologies. In such an embodiment, device 38 may offer a cost effective, 
reliable, and flexible solution to digital camera designs for a variety of different 
applications. As depicted, several modules share a single instance of processing 
electronics 40. Processing electronics 40 may include a common or shared camera image 
processing engine 54, camera control engine 56, triggering engine 58, and memory 60, 
which may support one or more of the engines resident in processing electronics 40. 

[1025] In the embodiment depicted in FIG. 2, image processing engine 54 may take raw 
image information captured by an ISL module or other sensor assembly and convert into 
a viewable image. Image processing engine 54 may be capable in some embodiments to 
effectively replace some functionalities provided mechanically in other systems. For 
example, module 42 may actually include a Mechanical Pan Tilt and Zoom (MPTZ) 
assembly, and module 44 may rely on processing engine 54 to effectively replicate the 
MPTZ functionality by processing the information captured by module 44 in a manner 
consistent with replicating the otherwise mechanical features. By relying on processing 
engine 54, module 44 may perform much like an MPTZ assembly without incurring some 
of the more typical challenges associated with the use of mechanical devices in cameras, 
such as frequent failures of the mechanical components, sluggish response to real-time 
video applications, and costly implementations. 

[1026] Camera control engine 56 may direct operational details like timing functions for 
various ISL modules. Triggering engine 58 may identify the one module from the group 
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of modules that is capturing a specific view of a scene and signal selector 52 to route the 
specific view information captured by the one module to processing engine 54. 

[1027] In preferred embodiments, modules 42, 44, 46, 48, and 50 may have different 
resolutions, different optical characteristics, and/or different fields of view. One optical 
characteristic that may be modified between multiple modules is focal length. Generally 
speaking, focal length is the distance between the lens and the surface of the sensor. The 
surface of a film sensor tends to be larger than the surface of a CCD or CMOS sensor. A 
typical 1.3-megapixel digital sensor is approximately one-sixth the linear dimensions of 
film. To project an image onto a smaller sensor, it is often necessary to shorten the focal 
length by the same proportion. 

[1028] Focal length is also a critical characteristic in determining how much 
magnification a user sees when looking through the lens of a camera. As focal length 
increases, magnification increases, and objects appear to get closer. As the focal length 
decreases, things appear to get farther away, but the sensor may capture a wider field of 
view in the camera. As such, device 38 may have two modules with different focal 
lengths and the same orientation. The same or similar point in space may represent the 
center of the modules' respective fields of view, but the first module may be narrowly 
focused on a point ten feet in front of device 38 and the second device may focus more 
broadly on a point twenty feet in front of device 38. 

[1029] The above example presupposes that the lenses of the two modules are fixed 
zoom lenses. Digital camera lenses may take several forms including fixed-focus/fixed- 
zoom, fish eye, panoramic, color, black and white, optical zoom, digital zoom, 
replaceable, or combinations thereof. A fixed-focus, fixed-zoom lens may be found on a 
disposable or inexpensive camera module. An optical-zoom lens with an automatic focus 
may be found on a video camcorder. The optical-zoom lens may have both a "wide" and 
"telephoto" option while maintaining image focus. 

[1030] A digital-zoom lens usually takes pixels from the center of the image sensor and 
"interpolates" them to make a full-size image. Depending on the resolution of the image 
and the sensor, this approach may create a grainy or fuzzy image when zoomed. Device 
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38 may effectively do the same thing a digital zoom lens is doing by selecting the center 
of the image using image processing software or logic and magnifying the selected 
portion. Such a feature may be implemented, for example, in image processing engine 
54. Some high-end digital cameras may also come with a replaceable lens system 
allowing the user to match the lens to the imaging need. 

[1031] As indicated above, a zoom lens is usually a lens that has an adjustable focal 
length. Digital cameras incorporating teachings of the present disclosure may have an 
optical zoom, a digital zoom, or both. An optical zoom actually changes the focal length 
of the lens. As a result, the lens magnifies the image. With greater magnification, the 
light is spread across the entire CCD or CMOS sensor and all of the pixels may be used. 
Optical zoom tends to be a true zoom that improves the quality of the captured images. 

[1032] A digital zoom involves bit manipulation and interpolation to magnify a portion 
of the information that hits the sensor. If a user is capturing a picture with a 2X digital 
zoom, the camera will use half of the pixels at the center of the sensor and ignore all the 
other pixels. The device will use interpolation techniques to add detail to the photo. 
Although it may look like the user is capturing a picture with twice the magnification, the 
user or the device can get the same results by capturing the photo without a zoom lens 
and "blowing up" the picture using software or logic. 

[1033] Referring back to FIG. 2, device 38 may be a single chip device and embodied in 
a single integrated circuit or formed on a common substrate 62. Substrate 62 may be 
mounted on a support 64 that has an exterior surface or mounting surface. As depicted, 
support 64 has a generally planar geometry. Supports could take several other 
geometries, including generally cylindrical geometries and generally spherical 
geometries. In some embodiments, devices like device 38 and/or individual ISL modules 
may be adjustably secured to a mounting surface. For example, if device 38 is part of a 
video conferencing appliance, an end user may want the ability to reposition the video 
sensors to ensure that each attendee of the videoconference is captured in at least one 
scene view or included in the field of view of at least one ISL module. Users may want 
this capability in other applications as well. For example, a city may want to make sure 
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that in a traffic camera application, all appropriate scene views are captured. In a 
surveillance application, a user may have similar desires. 

[1034] Whatever the application, an image capturing system incorporating teachings of 
the present disclosure may also include other types of sensors. The system could, for 
example, include motion detectors. A system may also include a microphone assembly 
like directional microphones 66 and 68. In addition to their normal functions, a 
directional microphone or a motion detector may act as a directional determination 
assembly that detects a direction of activity in a given scene and outputs a signal that 
indicates the activity direction. The signal may, in some embodiments, be communicated 
to triggering engine 58 or to some other directional determination engine. 

[1035] As mentioned above, device 38 may be incorporated into a video conferencing 
appliance. In such an embodiment, a speaker assembly 70 may be employed. Speaker 
assembly 70 and directional microphones 66 and 68 may be communicatively coupled to 
an audio engine 72 capable of managing A/D conversions and other audio specific 
functions. Audio engine 72 may be stand alone (as shown in FIG. 2) or included in 
processing electronics 40. In use, the various electronic components depicted in FIG. 2 
may be powered by on-board power like battery 74, some external source of power, or 
both. 

[1036] In some systems incorporating teachings of the present disclosure, an external 
computing system may be employed. As depicted in FIG. 2, external computing system 
76 is communicatively coupled via an interface to an output of processing electronics 40. 
Information captured by 42, 44, 46, 48, and/or 50 may be communicated to processing 
electronics 40 for manipulation and onto computing system 76, where the now-processed 
information may be processed again or communicated along to a remote computing 
systems 78, another videoconferencing device, or a plurality of remote systems and 
devices. 

[1037] The information communicated between computing system 76 and remote 
computing system 78 may be compressed and/or encrypted prior to communication via a 
circuit-switched network like most wireline telephony networks, a frame-based network 
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like Fibre Channel, or a packet-switched network that may communicate using TCP/IP 
packets like Internet 80. The physical medium caring the information could be coaxial 
cable, fiber, twisted pair, an air interface, other, or combination thereof. In some 
embodiments, a broadband connection may be preferred and an xDSL modem, a cable 
modem, an 802.1 lx device, another broadband wireless linking device, or combination 
thereof may be employed. 

[1038] As described above in the brief description of the drawings, FIG. 3 depicts a top 
view of an imaging appliance 82 that incorporates teachings of the present disclosure. As 
depicted, appliance 82 has multiple video capture devices 84, 86, 88, 90, 92, 94, 96, and 
98, each with different orientations and potentially different focal lengths and/or other 
optical characteristics. In operation, a given video capture device, like device 84, may be 
selected based on some activity occurring in the scene being "filmed" by device 84 or in 
a fashion that is similar to conventional video conferencing room cameras. 

[1039] For example, a user may manually toggle from device 84 to device 86. The 
toggling may, for example, result in a triggering signal being sent to a selection 
mechanism. In other embodiments, appliance 82 may "know" that a speaker is in the 
scene captured by device 90 and trigger the selection of device 90. This "knowledge" 
may come from various sources including directional microphones. In some 
embodiments, a speaker may wear a communication device like a Bluetooth or other 
radio frequency device that communicates with a similar device associated with 
appliance 82. In effect, the worn device may tell appliance 82 which video capture 
device is capturing the desired scene and should, therefore, be made "active". 

[1040] It should be noted, however, that as mentioned above some embodiments of 
appliance 82 may allow for more than one ISL module to be active at a time. With an 
appliance capable of multi-active ISL modules, the image that is generated by the 
appliance may be presented on a videoconferencing display as a collage of individual ISL 
images, a split screen image, a panoramic image, or some other and/or configurable 
display image. 



1033-T00529 Patent AppIication.doc 



- 10- 



Attorney Docket No.: 1033-T00529 



[1041] Appliance 82 may come pre-configured for a given type of room and application 
or it may be configured on site with ISL modules that present the views of the room that 
are needed. In one embodiment, appliance 82 may be designed to reside at the front of a 
room with the majority of ISL modules mounted on one side of appliance 82. Appliance 
82 may also be designed for middle of the scene applications like a conference room 
table, and individual ISL modules may have fields of view that overlap and ensure a 
panoramic view of the scene that covers 360 degrees. 

[1042] As depicted in FIG. 3, appliance 82 includes eight video capture devices with 
equally spaced orientations and overlapping views. For example, video capture device 84 
has an orientation with a centerline 84a and a field of view 84b. Similarly, video capture 
device 86 has an orientation with a centerline 86a and a field of view 86b. As shown, 
field of view 84b overlaps field of view 86b. This overlapping feature continues all the 
way around appliance 82 ensuring 360 degree coverage of the scene being captured by 
appliance 82. 

[1043] In some embodiments, appliance 82 may also include an MPTZ sensor module or 
a fixed focal length sensor module that relies on processing engine supported PTZ. 
These modules could be audio activated or have preset PTZ values that attempt to capture 
the best video to be transmitted to a remote device. A typical MPTZ sensor module can 
generate a swooping effect that may make some viewers uncomfortable. As such, a dual 
sensor design may be used. One of appliance 82 's video capture devices captures same 
scene video while another sensor or series of sensors tracks some motion or activity in 
the scene. When the motion or activity stabilizes, the inbound video feed is switched to 
the new video source. 

[1044] It will be apparent to those skilled in the art that the disclosed embodiments may 
be modified in numerous ways and may assume many embodiments other than the 
particular forms specifically set out and described herein. 

[1045] Accordingly, the above disclosed subject matter is to be considered illustrative, 
and not restrictive, and the appended claims are intended to cover all such modifications, 
enhancements, and other embodiments that fall within the true spirit and scope of the 
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present invention. Thus, to the maximum extent allowed by law, the scope of the present 
invention is to be determined by the broadest permissible interpretation of the following 
claims and their equivalents, and shall not be restricted or limited by the foregoing 
detailed description. 
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